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[0001] This application is based on Japanese Patent 
Application No. 2001-42471 filed on February 19, 2001, 
Japanese Patent Application No. 2001-121734 filed on April 
19, 2001 and JapanesePatent Application No. 2001-190303 filed 
on June 22 , 2001 , the contents of which are hereby incorporated 
by reference. 

BACKGROUND OF THE INVENTION 



Field of the Invention: 

[0002] The invention relates to an image-processing device 

for recogniz ing characters of a URL ( Uniform Resource Locator ) 
obtained by reading a printout of a Web page and generating 
the image data of the Web page to be outputted by connecting 
to its Web server. 



Description of Related Art: 

[ 0003 ] As the use of personal computers have becomes popular 



and the number of users of the Internet has increased in recent 
years , the chance of printing Web pages as well as the chance 
of copying web page printouts have increased due to the fact 
that the information exchange by means of printed media is 
5 still very popular. Unfortunately, however, the image 
quality deterioration produced as a result of copying Web 
page printouts tends to be conspicuous due to the fact that 
Web pages are normally designed as color pages. Therefore, 
various image-processing devices have been proposed 

10 ( JP-A-10-283313 and others) for obtaining printouts of Web 
pages based on the images with least quality deteriorations 
using various methods of reading the URL recorded on the 
document footer and elsewhere by character recognition, 
obtaining the HTML file by accessing the Web server identified 

15 by the URL, generating the image data of the Web page, and 
printing it out. 

[0004] However, those proposals have a universal 

shortcoming that they fail to consider and consequently cannot 
cope with a situation where connection cannot be made with 
20 an intended Web server due to reasons such as URL recognition 
errors, relocation or deletion of Web pages, congestions or 
operation interruptions of Web servers, etc. 
[0005] Moreover, even if the HTML file is obtained by 
accessing the Web server, these proposals may still end up 
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producing Web page image data different from the document 
due to reasons such as updates of the Web page. 
[0006] Moreover, the user may not always want a newly 
downloaded image from the intended Web page, but rather want 
5 the quickest way of outputting while maintaining the needed 
picture quality, or the best image quality while preferring 
the fastest outputting speed. Moreover, the user may wish 
to obtain high quality printouts by image downloading only 
in cases where fainting of thin lines and smearing of characters 

1 0 are expected to occur when the documents produced by the N-in-1 
method, i.e., printing the reduced images of multiple Web 
pages into one page, are copied. Furthermore, the user may 
wish to obtain outputs in color by downloading from Web pages , 
if the output device is capable of color printing, while 

15 existing documents are available only in monochromatic, as 
they can only result in monochromatic copies. The 
abovementioned image processing devices cannot cope with 
those requests by the user as well. 

[00071 The present invention is made to address the 
20 abovementioned problems of the prior art, and one objective 
of the invention to provide an image-processing device capable 
of outputting a document image data automatically when the 
image processing device, which normally generates and outputs 
Web page image data by reading a Web page printout , recogniz ing 
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characters of its URL, and connecting to a Web server, fails 
to be connected with the Web server for a certain reason. 
[0008] Another objective of the present invention is to 
provide an image-processing device capable of outputting an 
5 intended image data by specifying a proper image data when 
a Web page image read from a document is different from a 
generated Web page image. 

[0009] Yet another objective of the present invention is 
to provide an image-processing device capable of outputting 

10 an intended image data by properly selecting it between a 
document image data and a downloaded Web page image data based 
on the user's requirement prioritizing either quality or 
speed. 

[0010] Yet another objective of the present invention is 
15 to provide an image-processing device capable of outputting 
a high quality Web page image without any smeared characters 
by using downloaded Web page image data only when the particular 
document is an N-in-1 document. 

[0011] Yet another objective of the present invention is 
20 to provide an image-processing device capable of outputting 
in color even if a provided document is a monochromatic document 
by means of using a downloaded Web page image data only when 
the provided document is a monochromatic document and the 
output device is capable of outputting in color. 
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SUMMARY OF THE INVENTION 
[0012] The abovementioned objectives can be accomplished 
by the following means: 

[0013] (1) A data processing device connected to a server 
computer via a network comprising: 

an image reader for obtaining a image data by scanning 
a document image, wherein the document is printed based on 
a file published on the network by the server computer; 

an extracting means for extracting location information 
that indicates the location of the file from the image data; 

a transfer requesting means for requesting the server 
computer to transfer the file based on the location information 
extracted by the extracting means; 

a receiving means for receiving a file transferred by 
the server computer; and 

a transmitting means for transmitting the image data 
to a specific destination if it fails to obtain the file from 
the server computer based on the location information. 
[0014] (2) A data processing method executed on a data 
processing device connected to a server computer via a network 
comprising steps of: 

obtaining a image data by scanning a document image, 
wherein the document is printed based on a file published 



on the network by the server computer; 

extracting location information that indicates the 
location of the file from the image data; 

requesting the server computer to transfer the file based 
5 on the location information extracted by the extracting means ; 

receiving a file transferred by the server computer; 

and 

transmitting the image data to a specific destination 
if it fails to obtain the file from the server computer based 

10 on the location information. 

[0015] (3) A data processing program for causing a 

computer to execute every step described above. 
[0016] (4 ) A data processing device connected to a server 
computer via a network comprising: 

15 an image reader for obtaining a first image data by 

scanning a document image, wherein the document is printed 
based on a file published on the network by the server computer ; 

an extracting means for extracting location information 
that indicates the location of the file from the first image 

20 data; 

a transfer requesting means for requesting the server 
computer to transfer the file based on the location information 
extracted by the extracting means; 

a receiving means for receiving a file transferred by 
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the server computer; 

a data generating means for generating a second image 
data based on the file received by the receiving means; 

a judging means for judging whether the second image 
data agrees with the first image data; and 

a notifying means for notifying the user of the fact 
of the disagreement if it is judged by the judging means that 
the second image data does not agree with the first image 
data. 

[0017 ] ( 5 ) A data processing device connected to a server 
computer via a network comprising: 

an image reader for obtaining a first image data by 
scanning a document image, wherein the document is printed 
based on a file published on the network by the server computer ; 

a first extracting means for extracting location 
information that indicates the location of the file from the 
first image data; 

a second extracting means for extracting printing date 
that indicates the date when the document was printed from 
the first image data; 

a receiving means for receiving a file transferred by 
the server computer; 

a storage device for storing the file received by the 
receiving means; 



a file retrieving means for retrieving a file that has 
the same location information as the location information 
extracted from the first image data and was received later 
than the printing date extracted from the first image data; 
and 

a data generating means for generating a second image 
data based on the file retrieved by the file retrieving means . 
[0018] ( 6 ) A data processing device connected to a server 
computer via a network comprising: 

an image reader for obtaining a first image data by 
scanning a document image, wherein the document is printed 
based on a file published on the network by the server computer ; 

a first extracting means for extracting location 
information that indicates the location of the file from the 
first image data; 

a second extracting means for extracting printing date 
that indicates the date when the document was printed from 
the first image data; 

a receiving means for receiving a file transferred by 
the server computer; 

a storage device for storing the file received by the 
receiving means; 

a file retrieving means for retrieving a file that has 
the same location information as the location information 



extracted from the first image data and was received later 
than the printing date extracted from the first image data; 

a transfer requesting means for requesting the server 
computer to transfer the file based on the location information 
5 extracted by the first extracting means; 

a mode receiving means for receiving an instruction 
specifying either an image quality prioritizing mode or a 
speed prioritizing mode; 

a data generating means for generating a second image 
10 data based on the file retrieved by the file retrieving means 
and further generating a third image data based on the file 
transferred by the server computer in accordance with the 
file transfer request by the transfer requesting means; 

a first transmitting means for transmitting, in the image 
15 quality prioritizing mode, the second image data to a specific 
destination if the file retrieval means succeeds in retrieving 
the file, while transmitting the third image data to the 
specific destination if the file retrieval means fails to 
retrieve the file; and 
20 a second transmitting means for transmitting, in the 

speed prioritizing mode, the second image data to the specific 
destination if the file retrieval means succeeds in retrieving 
the file, while transmitting the first image data to the 
specific destination if the file retrieval means fails to 
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retrieve the file. 

[0019] ( 7 ) A data processing device connected to a server 
computer via a network comprising: 

an image reader for obtaining a first image data by 
5 scanning a document image wherein the document is printed 
based on a file published on the network by the server computer; 

an extracting means for extracting location information 
that indicates the location of the file from the first image 
data; 

10 a transfer requesting means for requesting the server 

computer to transfer the file based on the location information 
extracted by the first extracting means; 

a receiving means for receiving a file transferred by 
the server computer; 

15 a data generating means for generating a second image 

data based on the file received by the receiving means; 

a judging means for judging whether the document image 
is a reduced image consisting of multiple pages of the document 
based on the first image data; and 

20 a transmitting means for transmitting the second image 

data to a specific destination if it is judged by the judging 
means that the document image data is a reduced image consisting 
of multiple pages of the document, while transmitting the 
first image data to the specific destination if it is judged 
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that the document image data is not a reduced image consisting 
of multiple pages of the document. 

[0020] (8) A data processing device connected to a server 

computer via a network comprising: 
5 an image reader for obtaining a first image data by 

scanning a document image, wherein the document is printed 

based on a file published on the network by the server computer ; 
=== an extracting means for extracting location information 

□ that indicates the location of the file from the first image 

n 10 data; 

'3] a transfer requesting means for requesting the server 

'L^ computer to transfer the file based on the location information 

;^ extracted by the first extracting means; 

a receiving means for receiving a file transferred by 
15 the server computer; 

a data generating means for generating a second image 
data based on the file received by the receiving means; 

a judging means for judging whether the document image 
data is a color or monochromatic image based on the first 
20 image data; and 

a transmitting means for transmitting the first image 
data to a specific destination if it is judged by the judging 
means that the document image data is a color image, while 
transmitting the second image data to a specific destination 
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if it is judged that the document image data is a monochromatic 



image. 



BRIEF DESCRIPTION OF THE DRAWINGS 
[0021] Fig. 1 is a block diagram showing the entire 
constitution of an image processing system including the 
digital copying machine 11 according to the first embodiment 
of the present invention. 

[0022] Fig. 2 is a block diagram showing the constitution 

of the digital copying machine 11. 

[0023] Fig. 3 is a flowchart showing the steps of image 
processing for the digital copying machine 11. 
[0024] Fig. 4 is a diagram showing an example printout of 
a Web page. 

[0025] Fig. 5 is a diagram showing an example error message 
screen to be displayed on the operating panel unit 115 of 
the digital copying machine 11 when it fails to receive an 
HTML file from the Web server 2. 

[0026] Fig. 6 is a diagram showing another example error 
message screen to be displayed on the operating panel unit 
115 of the digital copying machine 11 when it fails to receive 
an HTML file from the Web server 2. 

[ 0027 ] Fig . 7 is a diagram showing an example URL correction 
screen to be displayed on the operating panel unit 115 of 
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the digital copying machine 11 when it is necessary to correct 
an URL error. 

[0028] Fig, 8 is a block diagram showing the entire 
constitution of an image processing system including the 
scanner 12 according to the second embodiment of the present 
invention. 

[0029] Fig. 9 is a block diagram showing the constitution 
of the scanner 12. 

[0030] Fig. 10 is a flowchart showing the steps of image 

processing for the scanner 12. 

[0031] Fig. 11 is a flowchart showing the steps of image 
processing for the scanner 13 according to the third 
embodiment . 

[0032] Fig. 12 is a diagram showing an example error message 
screen to be displayed on the operating panel unit 125 of 
the scanner 13 when the document image fails to match with 
the Web page image. 

[0033] Fig. 13 is a flowchart showing the steps of image 
processing for the digital copying machine 14 according to 
the fourth embodiment of the present invention. 
[0034] Fig. 14 is a diagram showing an example error message 
screen to be displayed on the operating panel unit 115 of 
the digital copying machine 14 when the document image fails 
to match with the Web page image. 



[0035] Fig. 15 is a diagram showing another example error 
message screen to be displayed on the operating panel unit 
115 of the digital copying machine 14 when the document image 
fails to match with the Web page image. 
5 [0036] Fig. 16 is a flowchart showing the steps of image 
processing for the scanner 15 according to the fifth 
embodiment . 

[0037] Fig. 17 is a diagram showing an example input screen 

for setting up the image data output mode to be displayed 
10 the operating panel unit 125 of the scanner 15. 

[0038] Fig. 18 is a flowchart showing the steps of image 

data transmission processing for the scanner 15. 

[0039] Fig. 19 is a diagram showing an example HTML file 

reception list for the scanner 15. 
15 [0040] Fig. 20 is a flowchart showing the steps of image 

processing for the digital copying machine 16 according to 

the sixth embodiment. 

[0041] Fig. 21 is a diagram showing an example document 
produced by printing Web pages in the N-in-1 (2-in-l) mode. 
20 [0042] Fig. 22 is a diagram exemplifying the method of 
judging whether the document image data is according to the 
N-in-1 document. 

[0043] Fig. 23 is a flowchart showing the steps of image 
processing for the digital copying machine 17 according to 
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the seventh embodiment of the present invention. 
[0044] Fig. 24 is a block diagram showing the entire 
constitution of the image processing system including the 
scanner 18 according to the eighth embodiment of the present 
5 invention. 

[0045] Fig. 25 is a flowchart showing the steps of image 
processing for the scanner 18. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
10 [0046] Detailed descriptions of various embodiments of the 
present invention will be presented below referring to the 
accompanying drawings. 

[0047] Fig. 1 is a block diagram showing the entire 
constitution of an image processing system including an 

15 image-processing device according to the first embodiment 
of the present invention. The image processing system has 
a digital copyingmachine 11 that serves as the image processing 
device and a Web server 20, which are connected to each other 
via a communication network 30. 

20 [0048] Fig. 2 is a block diagram showing the constitution 
of the digital copyingmachine 1 1 according to this embodiment . 
In Fig. 2, the digital copying machine 11 is equipped with 
a CPU 111, a ROM 112, a RAM 113, a hard disk 114, an operating 
panel unit 115, a document-scanning unit 116, a printing unit 
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117 and a network interface 118, all of which are interconnected 
via a bus 119 provided for exchanging signals. 
[0049] The CPU 111 is in charge of providing arithmetic 
operations and controls for various units mentioned above 
according to programs. The ROM 112 stores various programs 
and parameters. The RiVM 113 is a working area provided for 
temporarily storing various programs and parameters. The 
hard disk 114 is used for temporarily storing various programs 
and parameters as well as to store image data obtained by 
image processing, etc. The digital copying machine 11 
performs specific operations to be discussed later in this 
embodiment, and the program for controlling the digital 
copying machine 11 for this purpose is stored in the ROM 112 
or the hard disk 114. 

[0050] The operating panel unit 115 is equipped with a liquid 
crystal touch panel for displaying various information, a 
ten-key set for setting up the number of copies to be made, 
a start key for instructing the start of the operation, a 
stop key for instructing the stoppage of the operation, a 
reset key for initializing various setup conditions, etc. 
The document -scanning unit 116 generates image data (bit -map 
data) from electrical signals obtained by casting fluorescent 
light, etc. , on the document placed on the specified scanning 
position and converting the reflecting light into electrical 
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signals by means of photo detectors such as CCD and CIS. The 
document-scanning unit 116 is equipped with an automatic 
document feeder (ADF), so that it can scan multiple sheets 
of documents automatically by transporting each sheet to the 
5 specified scanning position by means of the ADF. 

[0051] The printing unit 117 prints the image data after 
image processing according to the setup condition. 
The network interface 118 is an interface connected to the 
network and is used for communicating with other equipment 
10 on the network and operates according to standards such as 
the Ethernet®, TokenRing, and FDDI. 

[0052] The Web server 20 is a computer having a WWW server 
function. The Web server 20 causes a document file of the 
HTML format laid open on the network as a WWW database and 
15 provides a function of transferring the HTML file in accordance 
with the client's request. 

[0053] The communication network 30 includes a public 
network such as a telephone network, ISDN, and a packet exchange 
network/ or a computer network such as LAN, WAN and the 
20 Internet. 

[0054] Fig. 3 is a flow chart showing the steps of image 
processing of the digital copying machine 11 according to 
the present embodiment . The digital copying machine 11 stands 
by until it receives the user's startup instruction (SlOl). 
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The user sets a document, on which a Web page is printed, 
to a specified position of the document table, sets up the 
copying conditions such as the number of copies to be made, 
paper size, scaling ratio, density, layout (such as theN-in-1 
5 function for laying out image data for N pages into output 
data for one page), single/double side copy, sorting, and 
finishing function (stapling, folding, punching functions, 
etc.) from the operating panel 115, and presses the startup 
key. 

10 [0055] uponreceiving the startup instruction from the user 
(SlOl: Yes) , the digital copying machine 11 obtains the image 
data by scanning the document (S102) , and stores the obtained 
document image data to the hard disk 114 (S103). 
[0056] Next, the character recognition process is 

15 performed on the specified area of the document image data 
(S104) . Fig. 4 shows an example of a document on which a Web 
page is printed. A document 51 obtained by printing a Web 
page has a specific area other than a text area 511, which 
consists of texts and graphics, for example, a header or a 

20 footer area, where the URL (Uniform Resource Locator) 512 
for the Web page is printed. In such a case, the efficiency 
of the character recognition process can be improved, as the 
character recognition process is concentrated on such area 
of the document image data, where the URL 512 is displayed. 
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Character recognition can be done using a method of identifying 
characters based on the degree of matching between the 
characteristic data of each character image and the dictionary 
pattern stored in advance. 

[0057] If said character recognition process fails to 
recognize the URL {S105: No) , the document image data stored 
in the hard disk 114 in the step SI 03 is read out to the RAM 
113 (S106), and the document image data is printed according 
to the setup condition by the printing unit 117 (S107). 
On the other hand, if said character recognition process 
recognizes the URL ( S105 : Yes ) , the HTML file transfer request 
is transmitted via the network interface 118 and the 
communication network to the Web server 20 specified by the 
recognized URL (SI 08). 

[0058] If it fails to receive the HTML file from the Web 
server 20 within a certain time period after transmitting 
the HTML file transfer request due to certain reasons, for 
example, misconnection due to errors in the URL character 
recognition, deletion or relocation of the Web page, 
congestions or operation interruptions of the Web server, 
etc. , (S109; No) , an error message screen 61 as shown in Fig. 
5 is displayed on the operating panel unit 115 (SllO), the 
document image data stored in the hard disk 114 in the step 
S103 is read to the RAM 113 (8106), and the document image 
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data is printed according to the setup condition by the printing 
unit 117 (S107) . 

[0059] In addition, it is also possible to adopt a 

constitution wherein "Reconnect after correcting URL" and 
"Document copy" buttons are provided on the error message 
screen 62 displayed on the operating panel unit 115 as shown 
in Fig. 6 in the error message display step SllO, so that 
the user can select either to try to correct the URL and 
reconnect with the Web server 20, or to output the document 
copy, when it fails to connect with the Web server 20 due 
to an URL recognition failure in the character recognition 
step S104. In this case, the user checks the URL displayed 
on the screen, presses the "Reconnect after correcting URL" 
button if there is an error in the URL, corrects the URL in 
the URL correction screen 63 displayed as shown in Fig. 7, 
and instructs the controller to reconnect. 
[0060] If the HTML file is received from the Web server 
20 within a certain time period after the HTML file transfer 
request is transmitted (S109: Yes), the received HTML file 
is analyzed and a transfer request for link files such as 
an image file is transmitted to the Web server via the network 
interface 118 and the communication network (Sill). If no 
link file is received from the Web server 2 within a certain 
period of time after the link file transfer request is issued 



due to reasons such as access congestion to the Web server 
(S112: No), an error message such as "Link file cannot be 
found" is displayed on the operating panel unit 115 (S113), 
and the document image data stored in the hard disk 114 in 
5 the step S103 is read to the RAM 113 (S106) , and the document 
image data is printed according to the setup condition by 
the printing unit 117 (S107). 

[0061] If a link file is received from the Web server 2 
3 within a certain period of time after the HTML file transfer 

10 request is issued (S112: Yes), a Web page image data is 
i°k generated based on the received HTML file and link file (S114), 

Q and the Web page image data is printed out by the printing 

ill 

Mi unit 117 according to the setup condition (S115). 

€1 

□ [0062] Fig. 8 is a block diagram showing the entire 

15 constitution of the image-processing system including the 
image-processing device according to the second embodiment 
of the present invention. This image-processing system 
consists of a scanner 12, which functions as the 
image-processing device, and the Web server 20, both of which 
20 are interlinked with the communication network 30. The 
scanner 12 is connected to a printer 40 via a local interface. 
[0063] Fig. 9 is a block diagram showing the constitution 
of the scanner 12 according to this embodiment. Fig. 9 shows 
that the scanner 12 includes a CPU 121, a ROM 122, a RAM 123, 
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a hard disk 124, an operating panel unit 125, a document 
scanning unit 126, a network interface 128, and a bus 129, 
all of which have identical functions as the corresponding 
units used in the digital copying machine 11 according to 
the first embodiment. The scanner 12 of this embodiment is 
also equipped with a local interface 127 . The local interface 
127 is an interface for the scanner to communicate with other 
equipment such as printers and personal computers without 
recourse to a network, and it can be either a serial interface 
such as USB and IEEE 1394, a parallel interface such as SCSI, 
or a wireless communication interface such as Bluetooth, IEEE 
802.11, HomeRF, and IrDA. 

[0064] The printer 40 provides printing output of printing 
images (bitmap data) . 

[0065] Fig. 10 is a flowchart showing the image processing 
steps of the scanner 12 according to this embodiment. The 
image processing steps of the scanner 12 in this embodiment 
are different from those of the image processing steps of 
the digital copying machine 11 of the first embodiment in 
that the document image data stored in the hard disk 124 in 
the step 8203 is read out to the RAM 113 (S206), and the document 
image data is transmitted to other equipment such as a printer 
via the local interface 127 or the network interface 128 { S2 1 6 ) , 
when the URL is not recognized in the character recognition 



process in the step S104 (S205: No), the HTML file is not 
received from the Web server in the step of HTML file transfer 
request transmission in the step S208 (S209: No), and the 
link file is not received from the Web server in the step 
of link file transfer request transmission in the step S211 
(S212: No). Moreover, if the URL is recognized (S205; Yes), 
the HTML file is received (S209: Yes), and the link file is 
received (S212: Yes) in the abovementioned steps , the scanner 
12 generates a Web page image data based on the received HTML 
file and link file (S214), and transmits the Web page image 
data to other equipment such as a printer via the local 
interface 127 or the network interface 128 (S217). 
[0066] Fig. 11 is a flowchart showing the steps of image 
processing for the scanner 13 according to the third embodiment 
of the present invention. The scanner 13 has a constitution 
similar to that of the scanner 12 according to the second 
embodiment, and is connected to the Web server 20 via the 
communication network 30 and to a printer 40 via a local 
interface respectively same as in the case of the scanner 
12. In Fig. 11, the scanner 13 stands by until it receives 
the user's startup instruction (S301). The user sets a 
document, on which a Web page is printed, to a specified 
position of the document table, sets up necessary copying 
conditions from the operating panel 125 and presses the startup 
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key. 

[ 0067 ] Upon receiving the startup instruction from the user 
(S301 : Yes) , the scanner 13 obtains the image data by scanning 
the document (S302), and stores the obtained document image 
data to the hard disk 124 (S303). 

[0068] Next, the character recognition process is 

performed on the specified area of the document image data 
(S304). If said character recognition process fails to 
recognize the URL (S305: No) , the document image data stored 
in the hard disk 114 in the step S303 is read out to the RAM 
213 (S306), and the document image data is transmitted to 
other equipment such as the printer 40 via a local interface 
217 or a network interface 218 (S307). 

[0069] On the other hand, if said character recognition 
process recognizes the URL (S3 05: Yes) , the HTML file transfer 
request is transmitted to the Web server 20 specified by the 
recognized URL via the network interface 218 and the 
communication network 30 (S308). Next, it stands by until 
it receives the HTML file from the Web server 20 (S309: No) . 
When it receives the HTML file from the Web server 20 via 
the communication network 30 and the network interface 218 
(S309: Yes), it analyzes the received HTML file (S310), 
transmits the link file transfer request to the Web server 
20, and generates the Web page image data as it receives the 



link file (S311) . 

[0070] Next, the document image data stored in the hard 
disk 214 is read out to the RAM 113 (S312) and the document 
image data is compared with the obtained Web page image data. 
5 This is done so because the generated Web page image may be 
different from the document image due to updating of the Web 
page, revision or misrecognition of the URL, etc. Such a 
discrepancy is detected by comparing the obtained Web page 
image data with the document image data, and a notification 

10 for the user of such a discrepancy is displayed urging the 
user to instruct which image data is to be output. The 
comparison of the Web page image data with the document image 
data can be performed by analyzing the layout of each image 
data, extracting each area, converting them to a uniform size 

15 by a normalization process, determining points at which the 
sum of the subtraction of the gradation values (or RGB 
histograms ) between the corresponding pixels of the two data 
by means of a pattern matching process is minimum, calculating 
the ratio of the pixels whose subtraction values at said points 

20 are less than a threshold value, and making a judgment that 
the two images match with each other if said ratio is greater 
than a certain specified value (a value empirically 
determined) or that the two images do not match if said ratio 
is less than said specified value. 
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[0071] If it is judged that the two images match with each 
other as a result of the comparison of the document image 
data with the Web page image data (S3 14: Yes), the Web page 
image data is transmitted to other equipment such as the printer 
40 via the local interface 217 or the network interface 218 
(S315) . This makes it possible to use the original image data 
of the Web page with less image quality deterioration compared 
to the document image data for the rest of the image processing . 
[0072] On the other hand, if it is judged that the two images 
do not match with each other as a result of the comparison 
of the document image data with the Web page image data (S314 : 
No), a message screen 64 notifying that the two image data 
do not match with each other is displayed on an operating 
panel unit 215 as shown in Fig. 12 (S316), and it stands by 
until the user enters an instruction specifying the image 
data to be outputted (S3 17: No). The user enters an 
instruction whether the document image data or the Web page 
image data to be outputted by pressing a virtual button on 
the message screen 64. When it receives from the user the 
input that specifies the image data to be outputted (S317: 
Yes), the scanner 13 transmits the image data specified by 
the user to other equipment such as the printer 40 vial the 
local interface 217 or the network interface 218 (S318). 
[0073] Fig. 13 is a flowchart showing the steps of image 



processing for a digital copying machine 14, an 
image-processing device according to the fourth embodiment 
of the present invention. The digital copying machine 14 has 
an identical constitution as that of the digital copying 
machine 11 according to the first embodiment, and is connected 
to the Web server 20 via the communication network 30 similar 
to the digital copying machine 11. The steps of the digital 
copying machine 14 according to this embodiment are different 
from the steps of the scammer 13 according to the third 
embodiment in: that, if the URL fails to be recognized in 
the character recognition process after the document image 
data is scanned and stored in the hard disk, it reads out 
the document image data from the hard disk 124 and prints 
it out (S401 through S406 and S407); that, if the URL is 
recognized, it compares the document image data with the 
generated Web page data after generating the Web image data, 
and prints the Web image data if the two images match (S405: 
Yes through S414: Yes, and S415) ; and that, if the two images 
do not match, it prints the image data specified by the 
instruction input (S414: No through S417: Yes, and S418). 
The difference is also in that, if the two images do not match 
in the comparison between the document image data and the 
Web page data, it displays not only a message that there is 
a mismatch between the two images, but also the document image 



data and the Web image data in order to allow the user to 
enter an instruction for the output image as a screen 65 shown 
in Fig. 14 (S416 and S417) . This enables the user to specify 
the output image by actually comparing the document image 
data and the Web image data. It is also possible to constitute 
in this case in such a way as to display a message screen 
66 as shown in Fig. 15 in order to allow the user to print 
both the document iiaage data and the Web page image data. 
It is also possible to constitute in such a way as to allow 
the user to specify as the printing method either the two 
single sided sheets, 2-in-l (a method of arranging the two 
pages of image on a single page output data) , or double sided 
printing method. It goes without saying that such a display 
is applicable to the scanner 13 according to the third 
embodiment. 

[0074] Fig. 16 is a flowchart showing the steps of image 
processing for the scanner 15, an image-processing device 
according to the fifth embodiment. The scanner 15 has an 
identical constitution as that of the scanner 12 according 
to the second embodiment. It is connected to the Web server 
20 via the communication network 30, and to the printer 40 
via a local interface similar to the scanner 12. In Fig. 16, 
the scanner 15 displays the input screen for setting up the 
image data output mode on the touch panel of the operating 



panel unit 115 (S501), and stands by until the user enters 
the input for setting up the image data output mode (S502: 
No). 

[0075] Fig. 17 is a diagram showing an example input screen 
5 for setting up the image data output mode to be displayed 
the touch panel of the operating panel unit 125 of the scanner 
15. The scanner 15 has four kinds of image data output mode, 
i.e., the "Document Image" mode, "Latest Image" mode, "Image 
Quality Prioritizing" mode, and "Speed Prioritizing" mode. 

10 With reference to a document, which is a printout of a Web 
page, the document image data itself is outputted as is in 
the "Document Image" mode, and the Web page image data based 
on the latest HTML file downloaded from the Web server 20 
is outputted in the "Latest Image" mode . In the " Image Quality 

15 Prioritizing" mode, it naturally outputs the Web page image 
data obtained from the HTML file, if the HTML file already 
exists, having been downloaded from the Web page and stored 
in the hard disk; or the Web page image data obtained from 
the HTML file newly downloaded from the Web page, if the 

20 corresponding HTML, file does not exist, thus prioritizing 
the image quality by means of outputting the image data having 
a better image quality than the document image data, using 
the image data obtained from the HTML file. In the "Speed 
Prioritizing" mode, it outputs the Web page image data obtained 
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from the HTML file, if the HTML file already exists, having 
been downloaded from the Web page and stored in the hard disk; 
or the dociunent image data, if the corresponding HTML file 
does not exist, thus prioritizing the speed by avoiding any 
new downloading of the HTML file from the Web page. In Fig. 
17, the setup screen 67 for setting up the image data output 
mode includes virtual buttons for allowing the user to select 
the image data output modes, so that the user can set up the 
desired image data output mode by pressing these buttons. 
[007 6] Upon receiving the user's setup input for the image 
data output mode (S502: Yes), the scanner 15 stands by until 
it receives the user's image scanning startup order (S503: 
No ) . The user sets a document, on which a Web page is printed, 
to a specified position of the document table, sets up other 
necessary copying conditions from the operating panel 125 
and presses the startup key pf the operating panel 125. Upon 
receiving the startup instruction from the user (S503: Yes) , 
the scanner 15 obtains the image data by scanning the document 
(S504), and stores the obtained document image data to the 
hard disk 124 (S505). Next, the image data transmission 
process is executed in accordance with the image data output 
mode received as the user's setup input in the step SI 02 (S506) . 
[0077] Fig. 18 is a flowchart showing the steps of image 
data transmission processing for the scanner 15. In Fig. 18, 



if the image data output mode instructed by the user is the 
"Document Image" mode {S601: Yes), the scanner 15 reads out 
the document image data stored in the hard disk 124 to the 
RAM 123 (S602 ) , and transmits the document image data to other 
5 equipment such as the printer 40 ( S603 ) via the local interface 
127 or the network interface 128. This makes it possible to 
output a document image data in the "Document Image" mode, 
which is preferable as it can reproduce a doc\unent identical 
to the original with some additional information, e.g., 

10 handwritten notes. 

[0078] On the other hand, if the image data output mode 
instructed by the user is the "Image Quality Prioritizing" 
mode (S601: No, S606: No, and S613: Yes), the character 
recognition process is executed in the specified area of the 

15 document image data (S604). As shown in Fig. 4, a certain 
area of the document 51 , for example, the header or the footer, 
contains not only the URL 512 of the Web page but also the 
printing data 513 when said Web page was printed, so that 
it is possible to recognize the URL and the printing data 

20 by applying the character recognition process to these areas . 
[0079] If it fails to recognize the URL and the printing 
date by means of said character recognition process (S605: 
No) , it reads the document image data from the hard disk 124 
(S602) similar to the steps of the "Document Image" mode. 
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and transmits the document image data to external equipment 
such as the printer 40 (S603). 

[0080] If it succeeds to recognize the URL and the printing 
date by means of said character recognition process (8605: 
5 Yes), it reads the HTML file reception list stored in the 
hard disk 124 to the RAM 123 and retrieves the HTML that is 
an HTML file related to said URL and is received later than 
said printing date, i.e., an HTML file newer than the document, 
fromthe HTML file reception list (S607 ) . Fig. 19 is an example 

10 HTML file reception list for the scanner 15. The HTML file 
reception list 71 stores the file name, the URL, the storage 
directory of the hard disk, and the reception date of the 
HTML file the scanner 15 received from the Web server on the 
communication network 30. If the HTML file newer than the 

15 document is detected from the HTML file list (S608: Yes), 
it reads out the corresponding HTML file to the RAM 123 from 
the hard disk 124 according to the storage directory of the 
HTML file reception list (S609) . Next , the obtained HTML file 
is analyzed (S610), and further reads out the link file from 

20 the hard disk 124 to generate the image data of the Web page 
(S611 ) . The generated Web page image data is transmitted to 
other equipment such as the printer 40 via the local interface 
127 or the network interface 128 (S612). 

[0081] On the other hand, if it fails to detect a new HTML 
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file newer than the document from the HTML file reception 
list (S608: No) , the scanner 15 transmits the HTML file transfer 
request to the Web page server 20 related to the Web page 
specified by the URL recognized in the character recognition 
5 step (S604) via the network interface 128 and the communication 
network 30 (S614) . Next, it stands by until it receives the 
HTML file from the Web server 20 (S615: No) . When it receives 
:Z; the HTML file from the Web server 20 via the communication 

network 30 and the network interface 128 (S615 : Yes ) , it stores 

ill 

i^i 10 the received HTML file m the specified directory of the hard 
ijl disk 124 (S616)/ and updates the HTML file reception list. 

D Next, it analyzes the received HTML file (S617), transmits 

M a link file transfer request to the Web server 20, receives 

5 the link file, and generates the image data of the Web page 

15 (S618). It transmits the generated Web page image data to 
other equipment such as the printer 40 via the local interface 
127 or the network interface 128 (S619). 

[0082] Thus, according to the "Image Quality Prioritizing" 
mode, while image data with good image qualities are outputted 
20 by means of always using image data obtained from HTML files, 
the output speed can also be improved by means of using an 
HTML file, if such an HTML file has been downloaded from the 
Web page and is already stored in the hard disk. 
[0083] If the image data output mode instructed by the user 
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is the "Speed Prioritizing" mode (S6OI1 No, S606: No, and 
S613: No), the character recognition process is executed in 
the specified area of the document image data (S604) same 
as in steps of the S604 through S612 of the "Image Quality 
Prioritizing" mode and, if it succeeds in recognizing the 
URL and the printing date (S605: Yes), it retrieves a HTML 
file newer than the document based on the URL and the printing 
date recognized from the HTML file reception list (S607). 
If a HTML file newer than the document is detected from the 
HTML reception list {S608: Yes), it reads out the corresponding 
HTML file from the hard disk 124 (S609), analyzes the HTML 
file (S610), generates the Web page image data (S611), and 
transmits it to other equipment such as the printer 40 (S612 ) . 
[0084] On the other hand, if it fails to detect a HTML file 
newer than the document from the HTML file reception list 
(S608: No), it reads the document image data from the hard 
disk 124 (S602) similar to the steps of the "Document Image" 
mode, and transmits the document image data to external 
equipment such as the printer 40 {S603). 

[0085] Thus, according to the "Speed Prioritizing" mode, 
while prioritizing the output speed by avoiding downloading 
of HTML files from Web pages, the image quality can also be 
improved by means of using an HTML file, if such an HTML file 
has been downloaded from the Web page and is already stored 



in the hard disk. 

[0086] If the image data output mode instructed by the user 
is the "Latest Image" mode (S601: No and S606: yes), it 
transmits the HTML file transfer request to the Web server 
5 20 related to the Web page specified by the URL (S614) same 
as in the steps S614 through S619 of the "Image Quality 
Prioritizing" mode. Upon receiving the HTML file from the 
Web server 20 (S615: Yes), it stores the received HTML file 
to the specified directory of the hard disk 124 (S616), and 

10 updates the HTML file reception list. It analyzes the received 
HTML file (S617), generates the Web page image data (S618), 
and transmits to other equipment such as the printer 40 ( S619 ) . 
Thus, in the "Latest Image" mode, Web page image data are 
always outputted using HTML files newly downloaded from Web 

15 pages, it is possible to output Web page printouts based on 
the latest Web page images. 

[0087] Although the present embodiment was described in 
the above using a scanner as an example of the image-processing 
device, the image-processing device is not limited to the 
20 scanner but can be any multiple function peripheral equipment 
(MFP) , for example, a digital copying machine having an image 
scanning function and an image forming function. In such a 
case, in the steps (S603, S612 and S619) of transmitting the 
image data to said external equipment, images can be first 



formed from said image data and then output instead of 
transmitting the image data to external equipment such as 
a printer. 

[0088] Fig. 20 is a flowchart showing the steps of image 
5 processing for the digital copying machine 16 according to 
the sixth embodiment. The digital copying machine 16 
according to this embodiment has an identical constitution 
as the digital copying machine 11 according to the first 
embodiment and is connected to the Web server 20 via the 

10 communication network 30. In Fig. 20, the digital copying 
machine 16 first stands by until it receives a startup 
instruction for document scanning from the user (S701: No) . 
The user sets a document, on which a Web page is printed, 
to a specified position of the document table, sets up other 

15 necessary copying conditions from the operating panel 115 
and presses the startup key. Upon receiving the startup 
instruction from the user (S701: Yes), the digital copying 
machine 16 obtains the image data by scanning the document 
(S702), and stores the obtained document image data to the 

20 hard disk 124 (S703). 

[0089] Next, it makes a judgment whether the obtained 
document image data is of an N-in-1 document, i.e. , a reduced 
image document obtained by printing an image data of multiple 
pages of HTML file for Web pages ( image data that would produce 
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multiple printed pages if printed under normal conditions 
under the equal scaling) reduced to fit into a single page 
(S704). Fig. 21 is a diagram showing an example document 
produced by printing HTML files for Web pages in the N-in-1 
5 (2-in-l) mode. In Fig. 21, a document 52 is an image of Web 
pages consisting of text portions 521 and graphics or 
photographs 522, wherein images 52a and 52b, which would 
produce two pages if the HTML files corresponding to said 
Web pages were to be printed normally in the equal scaling, 

10 are printed in a reduced size to fit into a single sheet of 
printing. The judgment of whether the scanned document image 
data is of a N-in-1 document can be made by counting the number 
of blocks sectored by blank spaces by detecting blank spaces 
of the image as the N value of the N-in-1 document image. 

15 In other words , the blank spaces are detected from a histogram 
821 obtained by integrating the number of pixels for each 
long side direction line 81 of the document image and a 
histogram 811 obtained by integrating the number of pixels 
for each short side direction line 82 as shown in Fig. 22, 

20 and a judgment is made whether it is an N-in-1 document image 
based on the number of blocks N determined from the detected 
blank spaces. In case of Fig. 22, a judgment is made that 
the image data of the document 52 consists of two blocks as 
the histogram 811 has one blank space (i.e., the histogram 
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is divided into two), so that it is a 2-in-l document image. 
In addition, it is also possible to use a method of applying 
a character recognition process to the scanned document image, 
data and judging that it is an N-in-1 document if multiple 
5 (N) URL or page numbers are recognized, as multiple (N) URL 
523 or page numbers 524 are displayed as shown in Fig. 21 
in case of an N-in-1 document. 

[0090] Unless the obtained document image data is of an 
N-in-1 document (S705: No), the digital copying machine 16 
10 reads out the document image data stored in the hard disk 
114 to the RAM 113 (S706), and prints it out after applying 
to it necessary image processing corresponding to the setup 
conditions, etc., (S707). 

[0091] On the other hand, if the obtained document image 
15 data is of an N-in-1 document (S705: Yes), it applies character 
recognition process to a specified area of the document image 
data (S708), reads out the document image data from the hard 
disk 114 (S706) if no URL is recognized as a result of said 
character recognition process (S709: No) , and prints out the 
20 document image data (S7 07 ) . If an URL is recognized as a result 
of said character recognition process (S709i Yes), a HTML 
file transfer request is transmitted (8710) to the Web server 
20 corresponding to the Web page indicated by said URL via 
the network interface 118 and the communication network 30. 
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Next, it stands by until it receives an HTML file from the 
Web server 20 (S711: No). Upon receiving an HTML file from 
the Web sever 20 via the communication Network 30 and the 
network interface 118 (S711: Yes), it analyzes the received 
5 HTML file (S712), transmits a link file transfer request to 
the Web server 20, generates a Web page image data (S713) 
upon receiving a link file, and prints the generated Web page 
image data after applying to it necessary image process 
corresponding to setup conditions, etc., (S714). 

10 [0092] Thus it is capable of automatically identifying 
whether a document image data is of an N-in-1 document and 
outputting a Web page image of high quality void of scratchy 
fine lines and character smearing that often occur in N-in-1 
document copies, even if it is of an N-in-1 document, by using 

15 Web page image data based on downloaded HTML files. 

[0093] Although the present embodiment was described in 
the above using a digital copying machine as an example of 
the image-processing device, the image-processing device is 
not limited to it but can be any multiple function peripheral 

20 equipment (MFP), for example, a facsimile machine having an 
image scanning function and an image forming function. 
Moreover, the image-scanning device of this embodiment can 
be a scanner as well and, in printing said image data in such 
a case, the image data printing processes (S707 and S714) 
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can be replaced with the process of transmitting the image 
data to external equipment such as a printer. 
[0094] Fig. 23 is a flowchart showing the steps of image 
processing for the digital copying machine 17 according to 
the seventh embodiment. The digital copying machine 16 
according to this embodiment has an identical constitution 
as the digital copying machine 11 according to the first 
embodiment. Incidentally, a printing unit 117 in the digital 
copying machine 17 is capable of color printing. Moreover, 
it is connected to the Web server 20 via the communication 
network 30 same as in the case of the digital copying machine 
11. In Fig. 23, the digital copying machine 17 first stands 
by until it receives a startup instruction for document 
scanning from the user (S801: No) . Upon receiving the startup 
instruction from the user (S801: Yes), it obtains the image 
data by scanning the document (S802) , and stores the obtained 
document image data to the hard disk 114 (S803). 
[0095] Next, a judgment is made as to whether the obtained 
document image is a color or monochromatic image (S804 ) . The 
judgment whether the document image data is color or 
monochromatic can be made by calculating the brightness 
histogram of the entire pixels of the image data and the 
brightness histogram of achromatic image pixels of the image 
data, obtaining the ratio of the pixels in the color areas 



against the entire pixels in the image data, and determining 
whether it is color or monochromatic based on whether said 
ratio is above or below a standard value. 
[0096] If the obtained document image data is incolor {S805: 
5 No), the digital copying machine 17 reads out the document 
image data stored in the hard disk 114 to the RAM 113 (S806) 
and prints the obtained document image data (S807). 
[0097] On the other hand, if the obtained document image 
data is monochromatic (S805: Yes), it executes the character 

10 recognition process in the specified area of the document 
image data (S808), reads the document image data from the 
hard disk 114 (S806) if no URL is recognized as a result of 
the character recognition (S809: No) , and prints the document 
image (S807). If an URL is recognized as a result of the 

15 character recognition (S809: Yes) , it transmits the HTML file 
transfer request (S810) to the Web server 20 corresponding 
to the Web page indicated by said URL. Next, it stands by 
until it receives an HTML file from the Web server 20 (S811: 
No) . Upon receiving an HTML file from the Web sever 20 via 

20 the communication Network 30 and the network interface 118 
(S811: Yes), it analyzes the received HTML file (S812), 
generates a Web page image data (S813 ) , and prints the generated 
Web page image data (S814). Thus it is capable of 
automatically identifying whether a document is in color or 
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monochromatic and outputting a Web page image in color, even 
if the document is monochromatic, by using a downloaded Web 
page image data on a digital copying machine capable of printing 
in color. 

5 [0098] Fig. 24 is a block diagram showing the entire 
constitution of the image processing system including an 
image-processing device according to the eighth embodiment 
of the present invention. The image processing system 
consists of a scanner 18, the image-processing device of the 

10 embodiment, and the Web server 20 connected via the 
communication network 30. The scanner 18 is connected with 
printers 40a, 40b and 40c via the communication network 30. 
The scanner 18 according to this embodiment has a constitution 
identical to that of the scanner 12 of the second embodiment. 

15 However, it does not necessarily have to have the local 
interface 127. 

[0099] Fig. 25 is a flowchart showing the steps of image 
processing for the scanner 18 . The steps of image processing 
for the scanner 18 according to this embodiment are different 
20 from those for the digital copying machine 17 according to 
the seventh embodiment in: that, in prior to scanning the 
document, it displays on the touch panel of the operating 
panel unit 125 the setup input screen to allow the user to 
select and set up the printer for outputting the image data 
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(S901) and accepts the setup input for the output printer 
from the user (S902 ) ; and that it transmits the document image 
data to the output printer (S908 and S909), which is set up 
by the input reception step for the output printer (S901 and 
5 S902), if the document image data is judged to be colored 
(S907: No) in the monochromatic/color identification step 
(S906), while, if the document image data is judged to be 
monochromatic (S907: Yes), it transmits the document image 
data to said printer (S908 and S909) if said output printer 

10 is capable of monochromatic printing only {S910: No), or 
transmits the Web page image data obtained from the Web server 
corresponding to the recognized URL (S911 through S917) if 
said output printer is capable of printing in color (S910: 
Yes). Thus it is capable of outputting suitable image data 

15 depending on whether the output device is capable of color 
output or monochromatic output only and, in case the output 
device is capable of outputting in color, automatically 
identifying whether the document is in color or monochromatic 
in order to output in color even if the document is 

20 monochromatic by using the downloaded Web page image data 
for a monochromatic document. 

[ 0100] The judgment of whether the specified output printer 
is capable of printing in color or printing only 
monochromatically can be made by communicating with said 
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printer when the output printer is selected at the step S902 
to receive the status information of said printer and making 
a judgment based on the status information; or by obtaining 
the status information of various equipment including the 
5 printer connected to the communication network 30 beforehand, 
storing it as a status information table in the RAM 113, etc. , 
and making a decision using it. 

[0101] Although the printer is identified as the 

destination of the image data transmission in the descriptions 

10 of the second, third, fifth and eighth embodiments, the 
destination of the document image data output is not limited 
to a printer, but can be any multiple function peripheral 
equipment capable of forming images such as a digital copying 
machine and a facsimile machine, or an image display device 

15 such as a display unit, or an image process device such as 
a personal computer. 

[0102] Although the Web server is identified as the file 
server connected to the communication network 3 0 in the 
descriptions of each embodiment in the above, said file server 
20 is not limited to it; nor the document file laid open in public 
is limited to the HTML file. 

[0103] The document image-processing device according to 
this invention is applicable to any multiple function 
peripheral (MFP) equipment capable of scanning image such 
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as a facsimile machine in addition to the digital copying 
machine and scanner mentioned in the description of various 
embodiments in the above. 

[0104] Various steps and image processing methods 

according to the present invention can be materialized either 
by means of a dedicated hardware circuit or a programmed 
image-processing device. In case of materializing the 
present invention by the programmed image-processing device, 
the program with which to operate the image-processing device 
can be provided by means of computer-readable recording media 
such as floppy disks and CD-ROMs . In such a case, the program 
stored in the computer-readable recording media is normally 
transferred to and recorded on a ROM, hard disk, etc. Such 
a program can be either provided as a standalone piece of 
application software or can be built into an image-processing 
device as a part of its functions. 

[0105] As described in the above, the image processing 
devices according to this invention are capable of 
automatically outputting document image data even if they 
encounter difficulties in connection to the Web server due 
to misrecognition of URLs, relocations or deletions of Web 
pages, or congestions or interruptions of Web servers, when 
they read printed Web pages, recognize the character their 
URLs , generate the image data of the Web pages by connecting 



to the Web servers and output them. 

[0106] Moreover, the image processing devices according 
to the present invention allow the user to select and output 
desired images when images of Web pages different from the 
5 document images due to updated Web pages, revised URLs, or 
raisrecognized URLs. 

[0107] Further, the image processing devices according to 
the present invention are capable of output printouts of Web 
pages in conformance with the user ' s preference, such as image 
10 quality prioritization or speed prioritization, by 
selectively outputting as needed either document image data, 
already downloaded Web page document data , or newly downloaded 
Web page document data. 

[0108] Further more, the image processing devices 

15 according to the present invention are capable of outputting 
high quality Web page images void of smeared characters , etc . , 
by means of making a judgment on whether the particular image 
is an N-in-1 document and using a downloaded Web page image 
data if it is an N-in-1 document. 
20 [0109] Further more, the image processing devices 

according to the present invention are capable of outputting 
in color, if the output device is capable of outputting in 
color, by making a judgment whether a document is in color 
or monochromatic, and using downloaded Web page image data 
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even in case of a monochromatic document. 
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